Structure of characteristic Lyapunov vectors in spatiotemporal chaos 
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We study Lyapunov vectors (LVs) corresponding to the largest Lyapunov exponents in systems with spa- 
tiotemporal chaos. We focus on characteristic LVs and compare the results with backward LVs obtained via 
successive Gram-Schmidt orthonormalizations. Systems of a very different nature such as coupled-map lattices 
and the (continuous-time) Lorenz '96 model exhibit the same features in quantitative and qualitative terms. Ad- 
ditionally we propose a minimal stochastic model that reproduces the results for chaotic systems. Our work 
supports the claims about universality of our earlier results [I. G. Szendro et al, Phys. Rev. E 76, 025202(R) 
(2007)] for a specific coupled-map lattice. 
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I. INTRODUCTION 

Nonlinear spatially extended systems often exhibit spa- 
tiotemporal chaos (STC), i.e. an apparent randomness in both 
space and time. Lyapunov exponents (LEs) measure the expo- 
nential separation (or convergence) of nearby trajectories and 
provide an important tool to characterize chaos in nonlinear 
dynamical systems [[ll0,[ll]. Not only exponential separation 
rates but also the associated directions in tangent space, the 
so-called Lyapunov vectors (LVs), are required when trying to 
tackle many important aspects of STC, such as, for instance, 
the role of hydrodynamic modes I'T], extensivity properties [S*] 
or predictability questions [2], among others. Random initial 
errors evolve in time and asymptotically align with the main 
LV corresponding to the most unstable direction. In practice, 
this limit is reached exponentially fast, so the memory of the 
initial perturbation is quickly lost. 

In extended systems, the spatial distribution and correla- 
tions of LVs are crucial to deal with questions such as pre- 
dictability [6]. The relevance of spatial correlations is partic- 
ularly apparent in the context of weather forecasting (see for 
instance Q). 

Localization of LVs in several distributed systems has been 
noticed and discussed in some extent in the literature [|8|, |9|, 
[Jo, 11, 12, 13, 14, 15]. This phenomenon has been termed dy- 
namical localization of eiTors [16]: The main LV rapidly tends 
to concentrate around a naiTow region of space. In homoge- 
nous systems, where all degrees of freedom are equivalent, the 
localization locus is not anchored to any fixed site, but keeps 
moving all over the system. However, in the case of inho- 
mogeneous systems LVs become strongly localized at certain 
fixed pinning centers and the phenomenon can be understood 
in terms of the problem of diffusion in quenched random po- 
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tentials llj 

Recently, the evolution of infinitesimal peTtmhations in spa- 
tially extended chaotic systems has been shown to be gener- 
ically describe d by Langevin-type equations with multiplica- 
tive noise lfT2l Il6l [TtI ISl- A remarkable observation in 
many systems fla\ is that, after a suitable logarithmic trans- 
formation, the statistical description of the dynamics of per- 
turbations is captured by the prototypical stochastic surface 
growth equation of Kardar-Parisi-Zhang (KPZ) \20}. In the 
surface picture eiTatic fluctuations, due to the chaotic nature of 
the trajectory, are treated as an effective noise. The existence 
of short-range coiTelations, coming from the deterministic na- 
ture of the trajectory, are irrelevant for the scaling description 
of the surface statistics. It is only natural that the existence of 
long-range correlations ||2ll] or a fat tail noise 1 19] may change 
the universality class observed. The surface picture has also 
been shown to be very useful to deal with the dynamics of 
finite perturbations in the presence of STC ll6l [I8II22I1 . 

In view of the successful description of the main LV as a 
nonequilibrium rough surface a question that naturally arises 
is to what extent can we describe LVs coiTesponding to other 
unstable directions in terms of surface roughening processes? 
This is precisely the question we recently addressed in a Rapid 
communication ll23ll . and that we develop here for a variety of 
systems. 

In the existing literature one finds that the LVs are com- 
monly defined as the vectors that appear as a byproduct of 
the standard Gram-Schmidt orthonormalization procedure to 
obtain the LEs. This is largely due to the popularity of Benet- 
tin's algorithm ll24ll25ll to compute the Lyapunov spectrum in 
all kind of dynamical systems. However, these vectors do not 
point in the most unstable directions, but are forced to form 
an orthogonal set. This is not a minor point because these 
vectors lack the intended physical meaning, which ultimately 
renders the Gram-Schmidt vectors useless for many purposes. 
For example, when the nth Gram-Schmidt LV, e„(t), is left 
to evolve freely it will not grow exponentially with its associ- 
ated LE A„ (apart from the case n — 1); instead, e„(t) will 
generally collapse in the direction of the first LV. However if 
the same vector e„ (t) is integrated backwards in time it will 
shrink with exponent — A„ (neglecting numerical round-off er- 
rors). Not less important is the fact that Gram-Schmidt LVs 
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depend on the scalar product convention used because it de- 
fines the orthogonaHzation condition. 

These important caveats have attracted renewed interest in 
the problem of finding the correct set of vectors that carry 
the dynamical information in systems exhibiting STC. Recent 
work has focused on the properties of a different set of vec- 
tors lEsl I26I IztIi . the characteristic LVs (also called covari- 
ant LVs), that are invariant under time reversal and covariant 
with the dynamics. This vector set is independent of the scalar 
product used and provides an intrinsic decomposition in tan- 
gent space which should correspond exactly with Oseledec's 
splitting Ol . Although the existence of the characteristic LVs 
is known since long III l28i l29l [soll it has not been until recent 
times that efficient algorithms have been devised to compute 
them mill- 

We have recently shown in Ref. fl^ that characteristic LVs 
carry important information about the real-space structure, lo- 
calization properties and space-time correlations, which can 
be put in the form of a dynamical scaling of the associated 
rough surfaces. These scaling properties were demonstrated 
for the particular case of lattices of coupled logistic maps, but 
conjectured to be valid for a wide range of systems (at least 
including all those reported in Ref. iflql as belonging to the 
KPZ class). 

In this paper we study the spatiotemporal structure of the 
characteristic LVs in different model systems exhibiting STC. 
Our aim is to analyze the spatial structure of the characteris- 
tic LVs. In particular, we wish to provide further verification 
of the previously reported scale-invariant properties of the LV 
surfaces (to be defined below) and its validity for systems that 
differ significatively from the special case of coupled-map lat- 
tices. Here we analyze systems of very different nature, in- 
cluding a coupled-map lattice (CML), the (continuous-time) 
Lorenz '96 model, and a minimal stochastic partial differential 
equation (PDE). We show that the leading LVs (corresponding 
to the largest LEs) generically exhibit scale-invariant proper- 
ties inherited from those of the main vector. Our present re- 
sults confirm and extend our earlier claim |23] concerning the 
generic, model independent, scaling properties of characteris- 
tic LVs corresponding to unstable intrinsic directions. 



n. MODELS OF SPATIOTEMPORAL CHAOS 

Three spatially extended systems are studied in this paper: a 
coupled-map lattice, a continuous-time model, and a stochas- 
tic equation. These models cover a range of dynamical sys- 
tems of very different nature, including discrete and continu- 
ous systems. We study models that exhibit STC for a range of 
parameters. Since the scaling properties that we are interested 
in are independent of microscopic details, our intention here is 
not to be exhaustive in the exploration of model parameters or 
different terms in a particular model, which have no effect on 
the scaling properties whatsoever. On the contrary, our aim is 
to address much more generic types of models, such as those 
that are discrete or continuous in space or time. 



A. Coupled-map lattices 

Coupled-map lattices are simple prototypes of STC at 
low computational cost This ultimately explains their 
widespread use to study different aspects of STC, which 
would be prohibitively demanding in computation time should 
PDEs be used, for instance. Here, we consider a ring of L 
maps with diffusive coupling 

u,it + 1) = efiu,+,{t)) + e/(w,_i(<))+ 

+ (l-2e)/(M,(<)), (1) 

where e is the coupling parameter and / is a map with chaotic 
dynamics. Infinitesimal random perturbations evolve in tan- 
gent space following the linear equation 

+ef{u,^i{t))5u,-i{t) + (1 - 2e)r{u,{t))5u,{t), (2) 

where f'{Q) is just the derivative of the map /(g) with re- 
spect to its argument g. We have recently reported in Ref. ll23ll 
about our study of the space-time structure of LVs in the case 
of the lattice of coupled logistic maps /(gi) = 4g(l — g). 
Here, as a further example we include the study of a differ- 
ent type of map. The results we report on in this paper (see 
below) are analogous to those obtained for logistic maps and 
thus we may conclude that no important differences should 
arise among one-dimensional CMLs composed of continuous 
chaotic maps in one variable. Throughout this paper, we con- 
sider the skew tent map with the same parameters as those in 
Ref. il: 

^^^>-\a[g-l)/{l-a) > 1/a) 

with a ~ 2.3. The Lyapunov spectrum of the CML in Eq. ([T]) 
for a coupling strength e = 0.2 is shown in Fig.lTta). 



B. Lorenz '96 model 

The second model we consider in this paper is an example 
of a chaotic continuous-time system. This model is in many 
aspects very different from a CML model due to the continu- 
ous character of the time variable. We study the model pro- 
posed by Lorenz in 1996 jsill as a toy model in the context of 
weather dynamics. We consider the variables j/i defined in a 
ring, z = 1, • • • , L, and the evolution equations 

d 

-^Vi = -Vi - yi~i{yi-2 - Vi+i) + F. (4) 

The variables yi may be looked at as the values of some un- 
specified scalar meteorological observable, like a vorticity or 
temperature, at equally spaced sites extending around a lat- 
itude circle |32]. The model contains quadratic, linear and 
constant terms mimicking advection, dissipation and external 
forcing, respectively. 
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FIG. 1 : Lyapunov spectra for the three models studied in this paper. 
We follow the standard convention and sort LEs in decreasing order 
Ai > A2 > ■ ■ ■ > Al. (The LEs were obtained for L — 128, larger 
systems yield Lyapunov spectra that overlap these ones.) 



An infinitesimal perturbation 5yi{t) evolves in tangent 
space according to the linearized dynamics 



dt 



-1 - yi+i)Syi~i 



yi-i5yi-.2+ 



(5) 



which also governs the dynamics of any characteristic LV, as 
they are freely evolving covariant perturbations. 

Regardless of how well or poor Eq. (|4]i represents the at- 
mosphere, the model is nowadays an essential tool in studies 
of weather dynamics as a testbed for forecasting techniques 
like breeding or singular vectors lIsTi [33, [33ll . For F = 8 the 
model exhibits STC, as demonstrated by computing the Lya- 
punov spectrum shown in Fig.lTJb). A Runge-Kutta scheme is 
usually recommended for the numerical integration of Eq. ^ 
to avoid numerical instabilities. We have used a fourth order 
Runge-Kutta integration algorithm with time step At = 10^^, 
while to achieve the same precision with the Euler method a 
much smaller time step. At — 1.5 x 10^^, was needed. 



C. Multiplicative stochastic equation 

The third model we study is a multiplicative stochastic 
equation, which mimics the linear evolution of infinitesimal 
perturbations in tangent space for spatio-temporal chaotic sys- 
tems. Pikovsky and Politi proposed I1I61I this stochastic PDE 



as the proper candidate for modeling the statistical features of 
the dynamics of freely evolving perturbations. Therefore, the 
analysis of this model will show to what extent the observed 
scaling of characteristic LV surfaces is generic and model- 
independent in the context of STC. 

We consider a perturbation (j){x, t), initially homogeneous 
and random, whose time evolution can be described, in a sta- 
tistical sense, by the multiplicative Langevin equation 



dt(f> = Cix, t)(j) + dx.j,(j), 



(6) 



where ^ is a noise term that accounts for the chaotic fluctu- 
ations and one can simply assume it to be Gaussian and un- 
con-elated: {C,{x,t) C,{x' ,t')) = 2a 6[x ~ x') 5{t - t'). It is 
worth stressing here that the presence of short-range coiTela- 
tions in the noise term Q (due to the purely deterministic nature 
of the fluctuations), is actually iiTelevant for the statistical de- 
scription in the long-wavelength limit, as already shown in the 
original work of Pikovsky and Politi 1 16]. 

We have numerically integrated Eq. (|6l) by a stochastic Eu- 
ler scheme (the noise term up to order At) with a space and 
time step Ax = 1 and At = 10^^. The Lyapunov spectrum 
was computed and averaged over different noise realizations 
(equivalent to different trajectories). In Fig. [TJc) we plot the 
LEs for a noise amplitude cr = 0.5. 

The multiplicative Langevin equation (|6]l can be seen as a 
stochastic field theory for the evolution of random errors in ex- 
tended homogeneous systems. This stochastic model has been 
found to describe the statistical properties of perturbations in 
many dynamical systems ranging from lattices of logistic, tent 
or symplectic maps to the complex Ginzburg-Landau equa- 
tion lfT2l [161 [21I1 . It has also been extended to construct a 
stochastic field theory of chaotic synchronization of extended 
systems |[34l [35[l . Very recently, it has also been shown that 
a version of Eq. ((6|, which includes quenched disorder terms, 
describes the propagation of perturbations in inhomogeneous 
chaotic systems 1,17(1 . 

Interestingly, the application of the Hopf-Cole transforma- 
tion, h = ln\(j)\, immediately maps the problem into the KPZ 
equation for surface growth: 



dth = c + {d^h)^ + d.,,h, 



(7) 



which ultimately justifies why the log-transformed (main) 
Lyapunov vector of many spatiotemporal chaotic systems is 
found to belong to the KPZ universality class |[l2l[T6ll . 

There is an interesting caveat concerning this mapping, 
which has not been noticed before in the context of STC. One 
can see that Eq. (O is invariant under the sign change of the 
field — > — 0. However, the solutions of Eq. ^ actually ex- 
hibit a spontaneous breaking of this essential symmetry. In 
our numerical integration we observe that for any random ini- 
tial condition, no matter the spatial distribution of signs for 
the initial field <j){x, t = 0), with probability one the solu- 
tions of Eq. (O asymptotically become either strictly positive 
or negative, (/. e., for long enough times (l){x, t) 7^ for all x). 
The reason for this symmetry breaking can be traced back to 
the mathematical properties of Eq. ((6|l. The key observation 
is that the dynamics governed by Eq. (O cannot produce new 
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zeros of the field 0. Therefore, sites where changes sign 
can only diffuse in the x axis and, in the event two 0-zeros 
collide, disappear. As we will see later on the annihilation of 
zeros is crucial to understand the spatial structure of charac- 
teristic LVs. 



III. LYAPUNOV VECTORS 

In short, LVs are defined as the vectors in tangent space 
that point towards the directions such that a given perturbation 
expands (shrinks) with the corresponding LE. Their physical 
significance arises from Oseledec's theorem [36]. Let us now 
discuss the definition and physical meaning of backward, for- 
ward, and characteristic LVs. 

Consider a nonlinear dynamical system governed by 

j^u{t) = r[u] (8) 

where u{t) G is the position of the system in phase 
space and Y : R"^ R^ is the nonlinear evolution operator 
Infinitesimal perturbations Su{t) follow the linear dynamics 
given by the tangent space equations: 

d „ , , dT\u] „ , , 

-Suit) Suit), (9) 

which implies that the perturbation can be computed at time t 
from the perturbation at an earlier time to as 

Suit) ^Mit,to)Suito), (10) 
where M(to, t) — M(t, to)^^ is some linear operator. 

A. Backward (and forward) Lyapunov vectors 

According to Oseledec's theorem l'36'l (details can also be 
found in Ref. 1 1 ]) there exists the remote past limit symmetric 

operator = limt„^_oo[M(t, to)M*(i, io)]^/!'^*"*'''!, 

where M* is the adjoint operator All L eigenvalues of *b(i) 
are positive time-independent numbers that can be written as 
exp(A„), where A„ are the LEs, and the corresponding eigen- 
vectors form an orthonormal basis {e„(i)}, n = 1, - ■ ■ ,L. 
These eigenvectors are called backward LVs ll28ll and repre- 
sent the directions in tangent space that, at the present time t, 
are seen to have grown at exponential rates A„ since the re- 
mote past. The set of backward LVs is precisely the orthonor- 
mal set obtained using the standard Gram-Schmidt orthogo- 
nalization method to compute the LEs |37]. 

Conversely, forward LVs form a different orthonormal 
set of vectors analogous to backward LVs, but with the 
temporal properties inverted. In this case they are ob- 
tained as the eigenvectors of the far future limit operator 
limto^oo[M*(io,<)M(io,i)]^/'^^*''~*^l which obviously has 
the same eigenvalues as 4>b(^)- When left to evolve freely 
from the present time t, the nth forward LV grows exponen- 
tially in the far future at a rate given by the corresponding LE 



A„. However under reverse (time backwards) integration all 
forward LVs collapse into the last forward LV. 

The popularity of the algorithm of Benettin et al. ll24l Izsll 
for computing the first n Lyapunov exponents, via successive 
Gram-Schmidt orthonormalization of a set of n vectors that 
evolve according to the linear equations in tangent space, has 
caused many authors to consider using the resulting orthonor- 
mal set {e„(t)}, n = 1, • • ■ , L, as the Lyapunov vectors. As 
mentioned in the Introduction, the use of this set of vectors 
poses serious problems in certain applications. Any of the L 
backward LV tends to align exponentially fast with the first 
LV. This has to be avoided by the externally imposed orthogo- 
nalization, which 'resets' the vector set every few time steps. 
Moreover, different scalar products produce different sets of 
backward and forward LVs. 



B. Characteristic Lyapunov vectors 

In order to construct a complete set of L characteristic (or 
covariant) vectors, {g„(t)}, n = 1, - ■ ■ ,L, independent of the 
scalar product and having the wanted topological properties, 
one has to intersect the subspaces spanned by the backward 
and forward LV in a precise manner as discussed by Eckmann 
andRuelle 

At variance with backward and forward LVs, characteristic 
vectors have the desired topological and dynamical properties: 
(i) They are independent of the scalar product; (ii) They re- 
duce to the Floquet eigenvectors for a periodic orbit llsotl : (iii) 
Any given gn(<) grows at an exponential rate given by the as- 
sociated LE A„ in the far future, and with rate — A„ backward- 
integrating to the remote past (under the linearized equations 
in tangent space, with no orthogonalization or any other ex- 
ternal constraint). For instance, in chaotic continuous- time 
systems, and in contrast with backward LVs, there is a char- 
acteristic LV tangent to the trajectory that corresponds to the 
zero LE associated with time-shift invariance. 

Contrary to the (artificial) orthogonal disposition of back- 
ward LVs, characteristic LVs generally do not form an orthog- 
onal set. We note that the first backward and characteristic 
LVs are tangent, g'i(i) oc ei(t). For n > 1, the nth charac- 
teristic LV is a linear combination of backward LVs from 1 to 
n. 

Although Eckmann and Ruelle fl*] already discussed these 
ideas in 1985, they had received little attention in the litera- 
ture until very recently. This is partially due to the fact that 
implementing such a theoretical construction is by no means 
a simple task from a computational point of view. Only very 
recently, Wolfe and Samelson |26] have proposed a computa- 
tionally efficient algorithm to obtain the set of characteristic 
LVs. We have used this algorithm in all our calculations, and 
technical details can be found in the Appendix. Also Ginelli 
et. al. have proposed a similar algorithm [27,1 . 

In the rest of this paper we study the spatial structure of 
LVs, focusing on universal features that are shared among dif- 
ferent models of STC. 
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IV. SURFACE GROWTH PICTURE 

In systems with spatiotemporal chaos the first LV localizes 
in space, so that its magnitude spans several orders of mag- 
nitude between the top and the valleys. In homogeneous sys- 
tems, translational invariance implies that the localization site 
is not static. 

It was recognized some time ago lfl2l [T^ that the spa- 
tiotemporal dynamics of the first LV is much more under- 
standable as a surface to be obtained after Hopf-Cole trans- 
forming the vector. Until recently, very little was known about 
the spatial correlations of characteristic (or backward) vectors 
for n > 1. We have reported |23] on the existence of intrinsic 
length scales and have determined the form of the spatiotem- 
poral correlations of LVs corresponding to the leading unsta- 
ble directions by translating the problem to the language of 
scale-invariant growing surfaces. We found that characteristic 
LVs corresponding to the most unstable directions also exhibit 
spatial localization, strong clustering around given spatiotem- 
poral loci, and remarkable dynamic scaling properties of the 
corresponding surfaces. In contrast, any two backward LVs 
localize in different sites since they are mutually orthogonal. 
Also, they do not exhibit dynamic scaling due to artifacts in 
the dynamical correlations by construction |23]. Our results 
were based on numerical studies of lattices of coupled-maps, 
but conjectured to be generically valid for a wide range of 
systems. Our aim here is to extend our previous analysis and 
put it in a wider context. For this purpose, the analysis of the 
stochastic model Eq. (|6]l has a particular significance. 

Figures |2f a), |2fc), and|2e) show typical snapshots of the 
first and second characteristic LVs in logarithmic scale for the 
three models introduced in Sec. |ll] One can see that both vec- 
tors may localize in the same site (which is not possible for 
backward LVs due to their mutual orthogonality). For every 
characteristic LV, gn{t) = [9n{x, t)]'xZi^ we define a surface 
via the Hopf-Cole transformation, hn{x,t) — \n\gn{x,t)\. 
For the sake of comparison we will also consider the surfaces 
associated with backward LVs: t) = In |e„(a;, t)\. After 

the mapping the nth LE corresponds to the average velocity 
of the corresponding nth surface, {{1/L) X]s=f hn{x, t)) — 

The surface growth formalism has allowed to identify 
different universality classes in spatiotemporal chaotic sys- 
tems fl^ [T^ [T^ I21I]. In particular, the universality class of 
KPZ has been widely observed in non-Hamiltonian systems 
with no special conservation laws, discontinuities or broken 
symmetries. This includes, among others, lattices of cou- 
pled logistic maps, and the Ginzburg-Landau and Kuramoto- 
Sivashinsky PDEs. The three model systems studied in this 
paper (see Sec.|ll]l also belong to KPZ universality class. This 
can be confirmed by calculating the so-called dynamic and 
roughness exponents. 

Interestingly, we have found that the nth LV (either char- 
acteristic or backward) is a piecewise copy of the main LV. 
This behavior is conveniently captured by the difference-field 
rjn = hn — hi. For instance in Figs. |2b), |2d), and|2f) we 
plot the difference-field 772 = /12 — hi, which reveals the ex- 
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FIG. 2: (Color online) The first and the second characteristic Lya- 
punov vectors for: (a) Coupled-map lattice Q, (c) Lorenz '96 model, 
and (e) Stochastic equation Note that we take the absolute values 
and a logarithmic scale for the y-axis. Panels (b),(d), and (f) show 
the fields rj2 — h2 — hi for the three models. 



istence of flat regions indicating that the first and the second 
LV surfaces are strongly correlated. The second LV surface is 
loosely speaking "piecewise KPZ", since it is made of pieces 
that differ from the main vector at only a few sites. Actually, 
the nth LV also exhibits the same structure for increasing n- 
namely, the difference-field 7y„ is also formed by flat regions 
separated by fluctuating edges. The typical plateau length of 
the field rjn naturally defines a characteristic length scale £„, 
below which the nth surface is identical to the first surface. 
This characteristic plateau size decreases with increasing n. 
So that, beyond some nmax, the number of fluctuating edges 
is so large (£„ 1 for n 3> nmax) that the "piecewise KPZ" 
picture is not useful any longer. 

It is remarkable that, for systems whose first LV belongs 
to the KPZ class, there is a finite part of the Lyapunov spec- 
trum (A„ with n < nmax) that can be understood in terms of 
piecewise copies of the first vector. Note that this peculiar spa- 
tial structure can only be easily identified after the logarithmic 
transform. Last but not least, this spatial structure is also con- 
sistent with the fact that, any characteristic LV is governed by 
the same tangent dynamics for a given system, Eqs. (|2]l, (|5]l, 
and Q, and a given trajectory. 



V. SPATIAL STRUCTURE 

In this section we carry out a quantitative descrip- 
tion of the spatial correlations of the LV surfaces 
hn{x,t). We compute the stationary structure factor 
Sn{k) = \imt^oo{hn{k,t)hn{~k,t)), where hn{k,t) = 
exp(ifca;)/i„(a;, i), and the brackets indicate an average 
over different system trajectories (or noise realizations in the 
case of the purely stochastic model). As expected the first LV 
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backward LVs 



characteristic LVs 




FIG. 3: Structure factors for LVs of the three models considered in 
this paper: (a,b) Coupled-map lattice lO with L = 1024, from top 
to bottom n = 1,4, 8, 16, 32, 64, 128; (c,d) Lorenz '96 model @ 
with L — 256, n = 1, 4, 8, 12; and (e,f) Stochastic equation ([6j with 
L = 1024, n = 1, 4, 8, 16, 32, 64. In all cases backward LVs (a,c,e) 
beyond the first one decay at small wavelengths as k"^ . Character- 
istic LVs (b,d,f) display stronger correlations with (7 ~ 1.15- 
1.2). We averaged over 200 realizations for the CML and 1000 for 
the other two models. 



surface correlations decay as (Fig.O, in agreement with 
KPZ universality class fl^,'2^. Interestingly, the nth LV sur- 
face for n> 1 also shows scale-invariant correlations ~ fc^^, 
with a crossover to a different scaling regime at a wavenum- 
ber k„ that depends on n. It is natural to link this crossover 
length scale to the plateaus discussed in the preceding section. 
Indeed, we have shown in Ref. ll23ll that this crossover wave- 
length is related to the typical size of plateaus lk„ ~ 

At long wavelengths, correlations of LV surfaces associated 
with backward and characteristic LVs decay approximately as 
k^^ and k"^-^, respectively (Fig. O. This l/fc-divergence 
indicates extremely weak long-range spatial correlations for 
both classes of LVs. However, backward and characteristic 
vectors exhibit markedly different dynamical properties. To 
be precise, the imposition of orthogonaUty causes the map- 
ping of a backward LV at t into itself at i + At to convey 1/fc 
long-range coiTelations. On the contrary, characteristic LVs 
show increasing correlation lengths as time evolves, as one 
would expect for a surface evolving with local equations. In 
this case (and in contrast with backward LVs), surface corre- 
lations are found to satisfy dynamic scaling akin to growing 
surfaces (cf. Fig. 4 in |23]). 

Deterministic equations ^ and ^ yield LVs whose spatial 
structure is analogous to the structure of LVs obtained with the 
stochastic equation (|6]l with white noise. This indicates that in 



spatiotemporal chaotic systems of the KPZ universality class, 
the role of spatio-temporal coiTelations is insignificant in what 
concerns the statistical (long-time and large-scale) structure of 
LVs. 

Finally, we recall that when n becomes large (n > rimax) 
specific features of each model will show up. For instance, 
in the case of the multiplicative stochastic equation, the nth 
LV appears as a noisy sinusoidal function because diffusion 
prevails over the stochastic term. Accordingly a peak appears 
at intermediate wave numbers in the structure factor [see the 
curve for n = 64 in Fig. Of)]. 



VI. MULTIPLICATIVE STOCHASTIC EQUATION 

The multiplicative Langevin model discussed in Sec. Ill CI 
constitutes a minimal model for describing the dynamics of 
free perturbations in a (wide) family of systems exhibiting 
spatiotemporal chaos 11 1611 . In particular, since random free 
perturbations rapidly tend to be tangent to the main LV, Eq. ^ 
also describes the scaling behavior of the first LV. As we 
have discussed in the preceding section, characteristic LVs are 
freely propagating perturbations, covariant with the dynam- 
ics as well as with the time inverted dynamics. Therefore, 
we conjecture here that the multiplicative stochastic model 
should also describe the statistics and scaling behavior of the 
nth characteristic LV, at least for n < n^ax- In this regard, 
the scaling properties of the nth characteristic LV in systems 
with STC should be generically linked to those of the solu- 
tions supported by the multiplicative Langevin model. In this 
section, we study in more detail the structure of the solutions 
and LVs in the multiplicative stochastic model. 

We have computed the characteristic LVs for the stochastic 
model. Figure|4]demonstrates the existence of plateaus for the 
differences ?y„(a;, t) — hn — hi, whose size decreases with n. 
The plateaus are bounded by kinks, which are prominently 
placed at the sites where gn{x,t) crosses zero (i.e. where 

hn{x, t) -00). 

The asymptotic attracting solution of Eq. (|6]l is the first LV, 
(j){x,t) = gi{x,t). As discussed in Sec. Ill CI the asymptotic 
solution gi{x, t) has the same sign everywhere. This solution 
is univocally determined for a given trajectory (noise realiza- 
tion), apart from an arbitrary non-zero constant factor The so- 
lution (j){x, t) = gi (x, t) has the statistical properties of a KPZ 
surface because the Hopf-Cole transformation from Eq. ^ to 
Eq. O is exact for n = 1. In contrast, characteristic LVs for 
n > 1 are saddle solutions of Eq. (|6]l, which are forced to have 
regions with opposite signs. This, in turn, naturally leads to 
smaller growth rates (A„ < Ai). 

We find that the number of zeros of the nth LV is A/q (n) — 
2 [n/2], where [q\ stands for the integer part of q. Note that 
Eq. (|6]l is not able to create new zero crossings, which implies 
that Afo{n) cannot fluctuate and is a conserved quantity. We 
also remark that A/o (n) corresponds to the number of zeros 
of the nth normal mode of the (noise-free) diffusion equation 
dt<t> — dxx4'^ assuming they are ordered according to their 
stability. 

It would be very interesting to be able to write down the 
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(a) (b) (c) (d) 




FIG. 4: Spatiotemporal plot of the fields (a) \dxrj2\ and (c) |9i:ry4 
for the stochastic PDE l|6j with L — 256; the plateaus appear as the 
clear regions. The darkest regions correspond to zeros of vectors g2 
and g4, indicated in panels (b) and (d), respectively. Other light gray 
regions in (a) and (c) correspond to kinks discussed in the text. 



Stochastic PDE describing the dynamics of the surface asso- 
ciated with the nth characteristic LV. However, this turns out 
to be a very difficuh task. A more quaHtative description can 
nonetheless be very useful. The first LV (n = 1) has no zeros 
and, as mentioned above, this allows us to exactly transform 
Eq. (|6]l into the KPZ equation Q. However for n > 1, each 
(?n (a:, t) has A/q (n) zeros, which cannot be neglected when ap- 
plying the Hopf-Cole transform. Indeed, one can observe that 
An = (dthn) ^ ( (Sa; /in )^), which indicates that there must be 
other terms contributing to the velocity of the nth Lyapunov 
surface. As expected, the equality Ai = (dthi) = {{dxhiY) 
exactly holds in the singularity-free case n = 1. 

A detailed analysis using the discrete version of ^ re- 
veals that the stochastic PDE governing /i„ is a KPZ equation 
with singular (and difficult-to-treat) terms at the points where 
hn —oo (gn ^ 0). Formally one can expect to have 

where the function accounts for singular delta-like 

contributions at the zeros Xi{t), whose positions move errati- 
cally around the system. 

We first note that the eiTatic motions of the zeros [Figs.HJb) 
and Sfd)] seem not to be the source of the long-ranged 
coiTelations. At long times, the erratic motion of ze- 
ros is sub-diffusive: the position of the ith zero satisfies 
{{xi{t) — Xi(0))^} V , and we find 7 « 0.87 for the sec- 
ond LV and 7 k, 0.62 for the fourth LV from numerical 
simulations in a system of size L = 256. We have already 
shown ll23ll that at long wavelengths (in the S{k) ~ k~^^^ 
region) surface correlations of characteristic LVs exhibit dy- 
namic scaling. The analysis of coupled-map lattices shows 



a fast propagation of correlations at large scales with a dy- 
namic exponent z = 1 corresponding to a ballistic process 
(7 = 2/z = 2). Since zeros do not propagate ballistically, but 
sub-diffusively, we conclude that information propagation at 
long wavelengths is mediated by a different process. The best 
candidates are small kinks [see, for instance, a typical kink at 
X K, 100 in Fig. 12 f)] that can be identified (light gray traces in 
the plots) as traveling objects in Figs.HJa) and|4jc). Interest- 
ingly, the dynamics of the kinks is governed by the equation 
of the field rjn, which can be written exactly inside a plateau 
region: 

dtVn = (dxTInf + dxxVn + 2{dxhi){dx71n) ■ (12) 

The drift term, proportional to dxTin, would lead to the ballis- 
tic dynamics of the kinks with z = 1. This provides the mech- 
anism for the ballistic propagation of correlations observed at 
long wavelengths. 



VII. DISCUSSION 

Our numerical results with the stochastic model ^ are par- 
ticularly revealing since they explicitly show to what extent 
equations for growing surfaces can be used to describe STC. 
Specifically, Eq. (|6]l is invariant under multiplication by a con- 
stant, (j) ccf), which leads to the symmetry h ^ h + lnc for 
the corresponding surface. This symmetry property leads to 
scale invariance of h ifssll . As equations for infinitesimal per- 
turbations are always of linear type, Eq. (|9|l, the symmetry 
(f) c(j) is always fulfilled and, in turn, systems with STC 
will exhibit scale invariance of the associated Lyapunov vec- 
tor surfaces. Different universality classes, depending on the 
existence of coiTelations or conserved quantities, may be ob- 
tained. 

A final remark is in order. The conservation of the num- 
ber of zero crossings, observed for Eq. (|6]l, is not fulfilled 
in general. In a generic setting, the dynamics of perturba- 
tions would be governed by linear equations that might con- 
tain higher-order derivatives multiplied by possibly fluctuat- 
ing coefficients dtSu = £,iSu + ^2dxSu + S^^dxxSu + • • • . 
Contrary to the perhaps oversimplified stochastic model (|6|l, 
zeros can be created in this general situation; for instance, if 
a drift term exists (^2 7^ 0), or if ^3 can take negative val- 
ues. Nevertheless, the scaling behavior of such a system is 
expected to be correctly described by Eq. (|6]l, because those 
model-specific terms are actually irrelevant in the sense of the 
renormalization group. In conclusion, the role of zeros is very 
important to understand the dynamics of (|6]l, but how they are 
linked to structural properties of generic systems with spatio- 
temporal chaos remains an issue for future work. 

In summary, in this paper we have studied spatiotemporal 
chaos in three qualitatively different (non-Hamiltonian) sys- 
tems. In all cases characteristic (and backward) Lyapunov 
vectors exhibit very similar spatial structure. The nth Hopf- 
Cole transformed LV is a piecewise copy of the first LV, with a 
typical plateau length that decreases with n. One of the three 
systems studied is a stochastic equation that serves as a mini- 
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mal model for the leading LVs in systems whose first LV be- 
longs to the universality class of KPZ. 
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APPENDIX: COMPUTATION OF CHARACTERISTIC 
LYAPUNOV VECTORS 

In this Appendix we outline the procedure we have fol- 
lowed to obtain the characteristic Lyapunov vectors. It is 
based on the work by Wolfe and Samelson lf26ll . It assumes 
that that there is no degeneracy in the Lyapunov spectrum; 
i.e. Ai > A2 > • • • > Al. For the sake of concreteness we 
restrict the following discussion to the CML model ([TJ, but it 
is not difficult to extend it to continuous-time systems. 

Given the initial state of the system 
u{tn = 0) = ['Ui(to),W2(to), • • • ,UL{h)\, infinitesimally 
small perturbations Suito) in the initial condition evolve up 
to linear order {i.e. in tangent space) according to 

5u,{t + l) = ef'{u,+i{t))5u,+i{t)+ef'{u,-i{t))Su,_i{t) 
+ il-2e)f'iu,{t))6u,{t) 

L 

with /' being the derivative of f{y) with respect to y and 
T[u.(i)] the L X L Jacobian matrix evaluated at u{t). The 
evolution of an infinitesimal perturbation Su{ti) is governed 
by the linear equation: 6u{tQ) ^ 'M.{tQ,ti)6u{ti). The lin- 
ear operator M is just the product of the Jacobian matrices 
evaluated along the system trajectory from ti to to, i.e. 

M{tn, ti) = T[u{tn-l)]T[u{h-2)] . . . T[u{h + l)]T[u{ti) 

According to Oseledec's theorem [3^ (details can be found in 
Ref. LU) there exists the limit operator 

^bito)^ lim [M{to,h)M*{to,ti)]W^ 

ti — 00 

such that the logarithms of the eigenvalues are the LEs A„, and 
the eigenvectors form an orthonormal basis {e^Jto)}. This 
set of eigenvectors, so-called backward LVs |l28t|, indicates 
the directions of growth of perturbations grown since the re- 
mote past with exponents A„. The backward LVs are precisely 



the orthonormal vectors obtained using the standard Gram- 
Schmidt orthogonalization method to compute the LEs |37]. 

Conversely the directions that will grow with exponents 
A„ are indicated by the so-called forward Lyapunov vectors 
{/n(io)}- They constitute an orthogonal basis formed by the 
eigenvectors of the operator: 

*/(io)= lim [M*(f2,<o)M(t2,to)]^<^3^ 

t2—*00 

As with the backward LVs, the Gram-Schmidt procedure 
can be used to obtain forward LVs, but now going back- 
wards in time and using the transposed Jacobian matrices 
because of the identity M(t2,to)* = T* [u{ta)]T* \uito + 
1)] . . . T*[u(<2)]- As noted by Legras and Vautard Q, the 
use of the transposed Jacobian (in contrast with the inverse 
ones) causes the forward LVs to come up with the standard 
ordering. This means that to obtain the first n forward LVs we 
need to integrate only n perturbations (instead of L — n + 1). 
Finally, note that computing forward LVs requires to store a 
trajectory u{tQ),u{tQ + 1), . . . ,u{t2). 

Each backward (resp. forward) LV grows with its exponent 
—Xi (resp. Ai) when it is left to evolve in the limit t ^ —00 
(resp. t 00). However both sets, backward and forward, 
do not follow their associated exponents when the time limit 
is reversed. For this reason it is much more interesting to con- 
sider another set of vectors {g„(t)}, the so-called character- 
istic LVs, that grow with exponent A„ (-A„) when integrating 
to the far future (past): 

lim {t^ta)-Hi-i\\M{t,to)gn{to)\\ = Xn. 

|t I — ^00 

The nth characteristic Lyapunov vector is a linear combi- 
nation of the first n backward Lyapunov vectors il39l] : 

n n 

gn ^^{ei,gn) =^ y^l''^ ei 

gn does not project on the subspace spanned by the n — 1 
first forward LVs. This allows, by means of some alge- 
braic transformation [26], to express the coefficient vector 

y (") — (yj"'' , 2/2"'' I ■ • ■ J Vn^ ) the one-parametric family of 
nontrivial solutions of 

where the nxn matrix D^"^ is calculated using the first n — 1 
forward LVs: 

n-l 

1=1 

y*^"-' is then completely determined (up to a global sign) im- 
posing normalization of 
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